Stability of Bosonic atomic and molecular condensates near a Feshbach resonance 
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We explore the Bose condensed phases of an atomic gas on the molecular side of a Feshbach resonance. 
In the absence of atom-molecule and molecule-molecule scattering, we show that the atomic condensate 
is either a saddle point of the free energy with energy always exceeding that of the molecular condensate, 
or has a negative compressibility (hence unstable to density fluctuations). Therefore no phase transition 
occurs between the atomic and molecular condensates. We also show that a repulsive molecule-molecule 
scattering can stabilize a sufficiently dense atomic condensate, leading to the possibility of a phase transi- 
tion. We caution that 3-body processes may render this transition unobservable. 
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PACS numbers: 03.75.Hh, 03.75.Kk 



Using Feshbach resonances (J], experimentalists can 
tune the interactions in atomic clouds El IE Hi 
For a system of Fermi atoms, this technique has allowed the 
study of a crossover between a BCS superfluid of Cooper 
pairs to a BEC superfluid of molecules pi la , L i W- Re- 
cently three separate theoretical groups W^ lloLfllll have pro- 
posed that for Bosonic atoms the same technique can pro- 
duce a phase transition between an atomic and a molecular 
superfluid (respectively called ASF and MSF henceforth, 
after If, as suggested by Romans et al [9] and Radz- 
ihovsky et al [10], this quantum transition is continuous, 
then it would be in the Ising universality class, with dra- 
matic signatures in the properties of vortices. The topolog- 
ical character of this phase transition makes it of intense 
interest to a large community of physicists. 

Here we show that in the limit of vanishing molecule- 
molecule and atom-molecule interaction (the same limit 
considered in ||9j] for constructing their phase diagram), 
no ASF<-^MSF phase transition can occur near a Feshbach 
resonance (defined as where the molecular binding energy 
approaches zero). Previous work[9, 10] showed that as one 
decreases the magnitude of the molecular binding energy, 
but before reaching resonance, the MSF becomes unstable. 
In those works it was assumed that the instability leads to a 
phase containing atomic superfluid order. We demonstrate 
that without the stabilizing influence of molecule-molecule 
interaction the system has a negative compressibility and 
this instability actually leads to a mechanical collapse of 
the cloud, and adding repulsive molecule -molecule inter- 
action only stabilizes the cloud at sufficiently high density 
(estimated at least three orders of magnitude higher than 
current experiments SHE!). 

Experiments are routinely performed fl2il on dilute 
atomic clouds on the molecular side of a resonance (i.e., the 
side on which a bound molecule exists), so this instability 
cannot be the whole story. Indeed, we verify the existence 
of a mechanically stable ASF in this region and show that it 
always has a larger energy than the molecular condensate, 
precluding the possibility of a phase transition (even a first 
order one). Furthermore, we demonstrate that this ASF is 
a saddle point of the free energy, and it is always energet- 



ically favorable for atoms to recombine into molecules. It 
is only the slow kinetics of this recombination, which re- 
lies upon three-body collisions, which allows experiments 
to be performed on atomic condensates. 

Phase diagram 

We model the Hamiltonian for a mixture of atoms and 
molecules near a one-channel Feshbach resonance as 

T = J [F m (x)+F a (x) + F am (x)]d 3 x (1) 

Fa = " ^Ja + ^W a Ma 

2m 2 

F am = 9 [^In^a^a + ^M^m] + Km^l^ a4> m 

F m = VV ^ m + (e - 2 M )^ m + ^ m ^ Mm 

where F a and F m represent the pure atomic and molecular 
contributions, and F am the coupling between them. Field 
operators ip a (x) and ip m (x) respectively annihilate atoms 
and molecules at position x (which is suppressed in these 
equations). Parameters A represent the strengths of elas- 
tic scattering, while g represents the strength of conversion 
between atoms and molecules, /x is the chemical poten- 
tial, and e < is the binding energy of a molecule, which 
can be controlled by tuning an external magnetic field. To 
treat this Hamiltonian within mean field theory one must 
renormalize the coupling constants from their bare values. 
For example, Duine and Stoof|14] have derived a simple 
renormalization scheme which connects these quantities 
with their bare values, providing their magnetic field de- 
pendence. 

In this letter, we find the stationary points of Q, and 
analyze their stability. We discuss two types of stability: 
dynamic, where small fluctuations do not grow in time; 
and thermodynamic, where small fluctuations cannot re- 
duce the free energy. Although a thermodynamic insta- 
bility implies that the system will eventually decay, the 
timescale, which is governed by kinetics and dissipation, 
may be long enough that the system appears stable. (In 
fact, since the ground state of alkali atoms at nano- Kelvin 
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FIG. 1 : Phase diagrams of Eq. Q without background atom- 
molecule scattering (A am = 0) in the parameter space of bind- 
ing energy e and density n (a) or chemical potential \i (b), at 
Am = 2A a . The various dotted lines separate phases with a dis- 
continuous transition, while the solid lines denote a continuous 
transition. The tricritical point between MSF and ASF in the two 
figures, at 7iA a A TO = 2g 2 , corresponds to the lowest density for 
which a stable ASF exists. 



temperatures is a solid, all experiments on ultracold atoms 
involve states which are thermodynamic ally unstable.) Fol- 
lowing convention, we take a thermodynamically unstable 
(but dynamically stable) phase to be metastable. 

As shown by previous authors Il9t 1 1 Oil , for g ^ 0, there 
are two possible superfluid orders: (a) a pure molecular 
condensate c/> m = (ip m ) / 0, <f) a = (<j) a ) = 0; and (b) 
a mixed atomic/molecular condensate <j) a ^ 0, (b m ^ 0. 
States with these respective orders will be called a molec- 
ular superfluid (MSF) and an atomic superfluid (ASF). 

Generically there are two classes of modes which can 
destabilize these states: density fluctuations, and pairing 
fluctuations. The latter modes change the relative pop- 
ulation of atomic and molecular states without changing 
the total density. Mueller and Baym lfl5ll characterized 
both types of modes within a random phase approxima- 
tion, showing that in the absence of a molecular bound state 
there is no phase transition between an atomic and paired 
superfluid. Our current calculation extends this result to 
the case where a true molecular bound state exists. 

Our primary result is the phase diagram in figure \l\ 
shown for X am = and X rn /X a = 2. Due to the presence 
of metastability in these experiments we do not limit our 
discussion to the thermodynamic ground state in each re- 
gion, but also analyze the stability of other stationary points 
of the energy, which can have either ASF or MSF character. 
These stationary points, hereafter called solutions, can be 
found by working at either fixed density or fixed chemical 
potential. 

Fixing the density, the "forbidden" region[20] contains 
three or four solutions: A 1; an ASF thermodynamically un- 
stable to pairing; A 2 , an ASF dynamically unstable to den- 
sity fluctuations; M, an MSF unstable to pairing; and op- 
tionally A 3 , an ASF dynamically unstable to relative phase 
fluctuations. The "MSF" region contains a stable MSF, and 
either one (Ai) or three (A , A 1; A 2 ) ASF solutions, two 
of which (A , Ai) are thermodynamically unstable to pair- 
ing while the other (A 2 ) is dynamically unstable to density 



fluctuations. A 1; however, is dynamically stable against all 
fluctuations if eA a < 2g 2 . That is, under these conditions, 
Ai is metastable. The "ASF" region contains two (A 1; A 2 ) 
or three (A 1; A 2 , A 3 ) ASF solutions, one (A 2 ) of which is 
stable. In this region the MSF (M) is unstable to pairing. 

Fixing the chemical potential, the "vacuum", where the 
ground state contains no particles, has an unphysical ASF 
solution 12 ill . The "MSF" region contains a stable MSF 
solution, an unphysical ASF solution[21], and possibly 
two more ASF solutions, one unstable and the other is 
metastable, possessing a higher free energy than the MSF. 
The "ASF" region contains three ASF solutions, one of 
which is unphysical[21|, one unstable[22], and one stable. 
The MSF is either unstable to pairing or has a higher free 
energy than this ASF solution. 

In the remainder of this paper, we derive these results; 
we find the stationary states of the Hamiltonian (0 and an- 
alyze their dynamic and thermodynamic stability against 
the two forms of fluctuation at A m = A am = 0. We then 
explore the role of finite A m and A am . We give full details 
for the calculation at fixed density, and briefly sketch the 
procedure for fixed chemical potential. 

Stationary States (fixed density) 

Assuming a uniform condensate exists, we replace the 
field operators in Eq. (0 by their expectation values, 
4> m = {ipm) = \/n^e l9m and cb a = (ip a ) = ^/n^e i6a , 
where n a / m and 6 a / m are the number of condensed 
atoms/molecules and their phase. The energy only depends 
upon the phase difference 4£ = 9 m — 26 a , so without 
any loss of generality we will take (f) a to be real and pos- 
itive. Setting d{J-)/d^ = shows that <p m must also 
be real, but not necessarily positive. We work at fixed 
n a + 2n m , writing c/> m = y / n/2x, and 
\/n\/l — x 2 with — 1 < x < 1. The points 
±1 represent the same state. The shifted energy 
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We define the dimensionless parameters a = 
\ a n^ 2 /2gV2 and (3 = e/2gV2^ < 0. For (3 < -1, 
as long as a is not too negative, there are two extrema 
as a function of x: the boundaries x = ±1 are lo- 
cal minima (M) and a maximum (Ai) lies between 
x = and x = 1. However, if a is reduced until 
(3 + 16a 2 - 8a/3) 3 = 27(1 - 4af3) 2 , we find two ad- 
ditional local extrema; a minimum at A 2 and a maximum 
at A . At (5 = —1, the x = — 1 point bifurcates, and for 
(5 > —1 it is a local maximum and the local minimum 
(A 2 ) is found in the region —1 < x < 0. Illustrative plots 
are shown in figure 0a). 

Previous analyses H 1 1 Oil show that the MC state M is 
always stable against density fluctuation, and is (thermody- 
namically and dynamically) stable against pairing fluctua- 
tions if and only if (3 < — 1. 
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FIG. 2: Scaled energy £ — (T) + (fi — e/2)n versus molecular 
condensate order parameter x — 4>m \j2jn for fixed n. (a) X m = 
Aam = 0: curves show — e > 2g\/2n (/3 < —1), — e < 2g\f2n 
(/3 > -1), and -e = 2px/2n (/3 = -1). For j3 < -1 there 
are two sub-cases: either a single stationary point (solid line) or 
three stationary points (dotted line), (b) A m ,A am 7^ 0: A3 does 
not exist if both of them are zero. 



Thermodynamic stability of the ASF is explored by cal- 
culating the Hessian Hij = d 2 £/didj, where i,j = x, n. 
Using the condition d£/dx = 0, these derivatives can 
be written as H xx = n[e + 2A(4n m — n a ) — 12g<f> m ], 
H xn = H nx = [g(4n m - n a ) - 2e<p m ]/V2n, H nn = 
n a (2n a X + 3g<f) m )/(2n 2 ). The determinant of the Hes- 
sian (the discriminant) is related to the compressibility, 
dp/dn = {H nn H xx - H 2 X )/H XX . For A 2 the discrimi- 
nant is always negative, while for A\ and A Q it is negative 
for Ae > 2g 2 and otherwise positive. Thus A 2 , which is 
always stable against pairing fluctuations (H xx > 0), is 
always thermodynamically unstable towards density fluc- 
tuations (i.e. has a negative compressibility). Similarly 
Ax and A are always thermodynamically unstable against 
pairing fluctuations (H xx < 0), and are thermodynam- 
ically unstable against density fluctuations if and only if 
Ae > 2g 2 . 

Dynamical stability is explored by calculating the equa- 
tions of motion for the fluctuations. We write the field op- 
erators in terms of density fluctuation p(r), pairing fluctu- 
ation y(r), relative phase fluctuation x(r), and total phase 
fluctuation 6(r). 



4> m (r) 



n + p(r) 



x + y(r)]e 



(3) 



&(r) = + p(r)y/l - (x + y(r)) 2 e i[fl(r) -*-* (r)1 
The equations of motion are found by making stationary 



(4) 



the action 

Working to quadratic order in the fluctuations, we find 

Pk = -k 2 e k k 2 Xk (5) 

m m 

up k - Anxdy k = —k 2 9 k 
m 



n 



—k* + H, 



nxxk 



[vk 2 - H nx \ — 



Pk 
4 



m 

n(3x 2 + 1) 



Xk 



k 2 + H x 



uXk 



3x 2 



16mn 



4m (1 — x 2 
-k 2 - H nn p k + [vk 2 - H nx ] y k 



Vk 
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where = — WV2n 3 gx(l — x 2 ), u = 1 — 2x 2 , 
v = 3x/8m, a = d t a and the Fourier components of the 
fluctuation operators are defined by 0(r) = ^ fc O k e zkr . 
As k — > the density and pairing modes decouple, and 
their frequencies are 

• 2 _, =<"./. T^, I 

(6) 



^density 
.2 



A 2 + 0(k 2 ) 



where the speed of sound is related to the compressibility 
by the standard expression c 2 = (n/m)dp/dn, and the 
gap to pairing excitation is A 2 = H xx H^/16n 2 x 2 . Since 
oc —x, Ai and A 2 are dynamically stable against pair- 
ing fluctuations, while A is unstable. Conversely, we see a 
dynamic instability towards density fluctuations if and only 
if a thermodynamic instability exists. 

Effect of non-zero A m and \ am 

We have seen that in the absence of X am and A m there is 
no stable ASF, and the metastable ASF always has larger 
energy than the MSF Hence there is no MSF<-^ASF phase 
transition. We now show the existence of a continuous 
MSF^->ASF phase transition when A m > 0. To produce 
such a continuous phase transition it is necessary and suf- 
ficient to show that there exists a stable ASF, with arbi- 
trarily small atomic fraction, at the point the MSF be- 
comes destabilized. In the presence of a non-zero A m 
and X am figure |3b) represents the generic structure of £; 
two minima at A 2 and A 3 and a maximum at A\. In 
terms of dimensionless parameters 7 = X m Wn/2/Sg 

and 77 = X am y / n/2/2g, A 2 3 appears at x = =Fl when 
(3 + 27 — r] = =pl, where the upper signs correspond to 
A 2 and the lower signs correspond to A3. 

The compressibility at x = =Fl when A 2t3 first appears 
is proportional to 1607 — (1 =F 2r\) 2 . So neither ASF is 
stable if 7 = 0, i.e., even when X am 7^ 0, a continuous 
MSF^ASF phase transition cannot exist if A m = 0. 

The curvature (H xx ) at x = =Fl when A 2 ^ 3 first appears 
is proportional to ±1 + 2{a + 7 — rj). At A 3 , oc — x 
is negative, and therefore A 2 oc H XX H^ is negative when- 
ever H xx > 0; i.e., A 3 is always either dynamically or ther- 
modynamically unstable against pairing fluctuations. The 
dynamical instability of A 3 even when H xx > can be un- 
derstood as instability against fluctuations in £, i.e., in the 
x — £ plane, the energy has a saddle-point at A 3 (recall that 
4£ is the relative phase between the atomic and molecular 
components). At A 2 , however, H xx > is equivalent to 
A 2 oc H XX H^ > 0. 

When the atom-molecule scattering vanishes (77 = 0), 
the stability conditions at A 2 , viz. H xx > and dp/dn > 
are simultaneously satisfied if and only if 7 > and 
16a7 > 1. Thus there exists an MSF<-^ASF continuous 
phase transition when X am = iff nA a A m > 2g 2 and 

Xm > Q. 
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Stationary States (fixed chemical potential) 

Working at fixed chemical potential (and taking A am = 
0), there are two type of stationary points of Eq. Q; 
an MSF: 4> a = 0, = (2/x - e)/A m , and an ASF: 
XaXm^m + (A«(e - 2//) - 2 5 2 )0 m + ^ = 0, # = 
(fi — 2g(p m ) / \ a . The ASF equation has three solutions, 
one of which can be ruled out ll2lll . Stability analysis is 
done for both ASF and MSF states by considering fluctua- 
tions in (j) m , <$>* m , <j) a and </>*, analogous to Eq. (|5j- In terms 
of dimensionless quantities ip = (j) m X m /g, r = \ m /\ a , 
e = e\ a /g 2 and v = fi\ a /g 2 , the MSF solution first ap- 
pears at 2v = e and is stable for v < (4 — 2V 4 — sr) jr. 
The two physical ASF solutions exist for u > v c where 
4(s — 2v c — 2) 3 + 27vlr = 0; one of them is always sta- 
ble, the other is stable for u > 0. The ASF^MSF tricrit- 
ical point is obtained by demanding that the two physical 
ASF solutions appear exactly when the MSF destabilizes. 
Mathematically, 

4(e - 2v - 2f + 27u 2 r = 

ip 3 + ipr(e - 2v - 2) + vr 2 = (7) 

p 2 - r(2u - e) = 

Solving these three simultaneously gives the tricritical 
point v tc = —2/y/r and e tc = —1 — r there- 

fore uniquely determines the phase diagram. Coupled with 
n = 2(j) 2 m = 2{2[i — e)/A m , this yields the familiar result 
n\ a X m = 2g 2 . 

Discussion 

We have shown that a continuous ASF<-^MSF phase 
transition can occur at sufficiently high density in a Bose 
gas near a Feshbach resonance with repulsive molecule- 
molecule interaction. This ASF does not, however, corre- 
spond to the phase currently studied in cold atom experi- 
ments. The experimental "phase" is a saddle point of the 
free energy, and always has a higher energy than the MSF. 

The most obvious route to studying this transition would 
involve first creating an MSF (for instance, using the tech- 
nique of Xu et al IU3I1 L then slowly ramping toward the 
resonance (making |e| smaller). As pointed out by previous 
authors [9, 10] the transition could be detected by observ- 
ing the behavior of vortices. 

We caution that this transition does not occur at arbitrar- 
ily low densities, nor in the absence of molecule-molecule 
scattering|24]. Therefore inelastic 3-body processes will 
inevitably limit the lifetime of the cloud 11611 . perhaps 
making these experiments impractical. In fact, estimat- 
ing the time scale of three-body recombinations 1 17] to be 
7"3-body ~ m/ha^n 2 with a s = h/y/me c (e c being binding 
energy for the transition) and n = 2g 2 /X a \ m already gives 
T 3-body ~ 10~ 4 s. Quantum interference effects can drasti- 
cally reduce this decay rate, but only at particular binding 
energies fl7ll . Using a photoassociation transition in lieu of 
Feshbach resonance may provide sufficient control over the 
parameters of the system to avoid these difficulties! 18]. 
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